Title: Cerebral Correlates and Statistical Criteria of Cross-modal Face and Voice Integration Short title: Face-voice Integration
نویسندگان
چکیده
Perception of faces and voices plays a prominent role in human social interaction, making multisensory integration of cross-modal speech a topic of great interest in cognitive neuroscience. How to define potential sites of multisensory integration using functional magnetic resonance imaging (fMRI) is currently under debate, with three statistical criteria frequently used (e.g. super-additive, max and mean criteria). In the present fMRI study, 20 participants were scanned in a block design under three stimulus conditions: dynamic unimodal face, unimodal voice and bimodal face-voice. Using this single dataset, we examine all these statistical criteria in an attempt to define loci of face-voice integration. While the super-additive and mean criteria essentially revealed regions in which one of the unimodal responses was a deactivation, the max criteria appeared stringent and ∗To whom correspondence should be addressed. E-mail: [email protected]
منابع مشابه
The effects of anxiety on the perception of emotion in the face and voice
Anxious individuals have been shown to be hyper-sensitive to cues for others’ negative emotional states. As most studies used facial expressions as emotional cues, we examined whether the trait anxiety affects the cross-modal perception of emotion in the face and voice that were simultaneously presented. The face and voice cues conveyed either matched (e.g., both positive) or mismatched emotion...
متن کاملCross-modal Bias of Voice Tone on Facial Expression: Upper versus Lower Halves of a Face
Emotional states are communicated by seeing the face as well as by listening to affective prosody. The two inputs can also be present at the same time and are then processed concurrently. The present experiment examines the role of the voice on the upper versus lower halves of a face. Previous research using an angry-fear facial expression continuum showed that recognition of the lower half of ...
متن کاملDissociating task difficulty from incongruence in face-voice emotion integration
In the everyday environment, affective information is conveyed by both the face and the voice. Studies have demonstrated that a concurrently presented voice can alter the way that an emotional face expression is perceived, and vice versa, leading to emotional conflict if the information in the two modalities is mismatched. Additionally, evidence suggests that incongruence of emotional valence a...
متن کاملIs cross-modal integration of emotional expressions independent of attentional resources?
In this study, we examined whether integration of visual and auditory information about emotions requires limited attentional resources. Subjects judged whether a voice expressed happiness or fear, while trying to ignore a concurrently presented static facial expression. As an additional task, the subjects had to add two numbers together rapidly (Experiment 1), count the occurrences of a target...
متن کاملNeurobiological correlates of emotional intelligence in voice and face perception networks
Facial expressions and voice modulations are among the most important communicational signals to convey emotional information. The ability to correctly interpret this information is highly relevant for successful social interaction and represents an integral component of emotional competencies that have been conceptualized under the term emotional intelligence. Here, we investigated the relatio...
متن کامل